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Abstract — For every Gaussian relay network with a single 
source-destination pair, it is known that there exists a corre- 
sponding deterministic network called the discrete superposition 
network |1| that approximates its capacity uniformly over all 
SNR's to within a bounded number of bits. The next step in 
this program of rigorous approximation is to determine whether 
coding schemes for discrete superposition models can be lifted to 
Gaussian relay networks with a bounded rate loss independent 
of SNR. We establish precisely this property and show that the 
superposition model can thus serve as a strong surrogate for 
designing codes for Gaussian relay networks. 

We show that a code for a Gaussian relay network, with 
a single source-destination pair and multiple relay nodes, can 
be designed from any code for the corresponding discrete 
superposition network simply by pruning it. In comparison to 
the rate of the discrete superposition network's code, the rate of 
the Gaussian network's code only reduces at most by a constant 
that is a function only of the number of nodes in the network 
and independent of channel gains. 

This result is also applicable for coding schemes for MIMO 
Gaussian relay networks, with the reduction depending addition- 
ally on the number of antennas. 

Hence, the discrete superposition model can serve as a digital 
interface for operating Gaussian relay networks. 



I. Introduction 

Computing the capacity of a general Gaussian network 
is a formidable problem. This has motivated the pioneering 
work of | 3 1 which aims at developing a class of deterministic 
networks that can serve as surrogates for Gaussian networks. 

The first issue that needs to be settled in such a program 
is to show rigorously that deterministic networks can indeed 
approximate the capacity of Gaussian relay networks. This was 
done in |2| and |T| via different models. The model used in 
(T], called a discrete superposition model, is a more discrete 
model in the sense that channel gains and inputs are discrete 
valued, while they are complex valued in |2|. 

The next issue in this program of investigation is to rig- 
orously establish a correspondence between coding schemes 
for Gaussian and superposition networks. Here we show that 
coding strategies for the discrete superposition model can also 
be lifted to the Gaussian relay network in such a way that 
they continue to provide comparable performance. The lifting 
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procedure is particularly simple and consists essentially of just 
pruning the codewords and using jointly typical decoding. 

The discrete superposition model thus provides a digital 
interface for operating the Gaussian network since any coding 
scheme for the superposition model defines a finite set of 
transmit signals at every node in the Gaussian network, a 
finite set of signals for decoding its received signal to, and a 
mapping from decoded signals to transmit signals. Operating 
the Gaussian network on this precise digital interface will 
achieve rates that are close to its capacity if the original 
scheme for the discrete network does so, thereby providing 
a framework for designing optimal strategies. 

The superposition model may potentially be easier to design 
codes for than the Gaussian model since noise has been 
eliminated from the network and the set of inputs and out- 
puts are finite. Potentially, perhaps, wireless network coding 
could be useful too in studying superposition networks, and 
subsequently Gaussian networks. 

A. Summary of previous work 

The linear deterministic model, introduced in 0, captured 
broadcast and interference in a wireless network, and the 
effect of noise in a Gaussian network. Networks constructed 
with this model approximate the capacity of the original 
Gaussian network for certain examples like multiple-access 
1 3 1, broadcast |3|, and the two-user interference channels (H. 

However, the linear deterministic model cannot capture the 
phase of a channel gain 1 1 1 and also substantially reduces the 
received signal power at a node Q, 121, due to either of which 
relay networks constructed with this model can have arbitrarily 
lower capacity than the original Gaussian network. Hence, the 
linear deterministic model fails to approximate the capacity of 
Gaussian relay networks. 

II. Model 

A. System model 

We begin by describing the class of Gaussian relay networks 
of interest. We consider a wireless network represented as a 
directed graph (V, f ), where V = {0, 1, ... , M} represents 
the set of nodes, and the directed edges in 8 correspond to 
wireless links. Denote by hij the complex channel gain for link 
(z, j) G 8. Let the complex number Xi denote the transmission 
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of node i. Every node has an average power constraint, taken 
to be 1. Node j receives 

where A/'(j) is the set of its neighbors, Zj is complex white 
Gaussian noise, CA/'(0, 1), independent of transmitted signals, 

and hij hijR^ihiji. 

B. Discrete superposition model 

We associate with the above Gaussian relay network a 
deterministic model, as follows. Let 

n := max max{[log|/ii^i^|J, [log|/ii^/|J}. (2) 

The inputs are complex valued, and both real and imaginary 
parts take values from the 2^ equally spaced discrete points 
{0, 2~^, . . . , 1 — 2~^}. The real or imaginary part of an input 
can be represented in terms of its binary representation x = 
ELi 2"^x(A:), with each x{i) e ¥2. 

The real and imaginary parts of channel gains in the 
Gaussian network are quantized to integers by neglecting their 
fractional parts, h^^ below denotes the quantized channel gain 
for link (i, j): 

^ij '= [hij] := sign{hijR)[\hijR\\ ^tsign{hiji)[\hiji\\. (3) 

The channel between two nodes in the discrete superposition 
network multiplies the input by the corresponding channel 
gain and quantizes the product by neglecting the fractional 
components of both real and imaginary parts, i.e., it forms 
[h-jXi]. The outputs of all incoming channels at a receiver 
node lie in Z + zZ. All the quantized outputs are added up 
at a receiver by the standard summation over Z + zZ. The 
received signal at node j is given by 



(4) 



This model retains the essential superposition property of the 
wireless channel. Quantization of channel coefficients does not 
substantially change the channel matrix in the high SNR limit. 
Also, the effect of noise is captured by constraining the inputs 
to positive fractions that can be represented by finite bits and 
by quantization of the channel output. 

An important property of the discrete superposition model is 
that transmit signals in it satisfy a unit peak power constraint, 
and are thus also valid for transmission in the Gaussian 
network. That is, encoder outputs in the discrete superposition 
network can also be used in the Gaussian network. 



A Gaussian relay network is shown in Fig. 1(a) where each 
wireless link is labeled with its channel gain and we have 
explicitly indicated the addition of Gaussian noise at every 
receiver. In comparison, its discrete superposition counterpart 



in Fig. 1(b) preserves multiplication by channel gains and the 
superposition property of the channel, with the Gaussian noise 
replaced by quantization of outputs. 

The discrete superposition model was first used in |4 | in a 
sequence of networks that reduced the Gaussian interference 
channel to a linear deterministic interference channel. It was 
generalized and given its name in 1 1 1. 




(a) A Gaussian relay network. 




(b) Discrete superposition model of above network. 
Fig. 1. Gaussian and discrete superposition models of a network. 

III. Lifting a coding scheme for the discrete 

SUPERPOSITION NETWORK TO THE GAUSSIAN NETWORK 

A coding strategy for either the Gaussian or superposition 
relay network specifies codewords transmitted by the source, 
a mapping from the received signal to a transmit signal for 
every relay node, and a decoding function for the destination. 

We describe how to lift a coding strategy for the discrete 
superposition network to a strategy for the Gaussian network. 

Consider a (2^^, A/") code for the discrete superposition 
network with zero probability of error, for a certain N. 
The probability of error can be reduced to zero due to the 
deterministic nature of the network; see Sec. |IV-A1| 

Denote the block of N transmissions at node j in the 
discrete superposition network by an A'-dimensional transmit 
vector X and similarly the received vector hy y .. All signals 
in the discrete superposition network are a (deterministic) 
function of the codeword Xq transmitted by the source. 

Next, we build a (2^^^,nAr) code, denoted by Co, for 
the discrete superposition network, with every nA^-length 
codeword constructed by adjoining n codewords from the old 
code, for a large n. This is again a rate R code since it simply 
uses the old code n times on the superposition network. 

In the (2^^^,nA') code, node j 

1) breaks up its received signal, denoted by y ., into n 
blocks of length N, 

2) applies the mapping used in the (2^^, N) code on each 
of the n blocks to generate n blocks of transmit signals, 

3) and adjoins n blocks of transmit signals to construct a 
new transmit signal, denoted by x^ , of length nN . 

As shown in Fig. [2j the relationship between various signals 
associated with the transmission of node j is akin to packeti- 
zation in computer networks. 

A subset of the codewords of Co, defined below, forms the 

set of codewords of the code for the Gaussian relay network. 

Pruning the set of codewords: Node j has a finite set of e- 

7 ~ — ~ 

strongly typical y .'s (see ||5|) in the code for the superposition 



3 



I I 



TV symbols 



n transmit signals in the (2^^, TV) code 
\ 

I |xj 

Transmit signal in the (2"^-^,nTV) code 

Fig. 2. Relationship among the signals transmitted by node j. 

network. We randomly, i.e., independently and uniformly, pick 
^ 2-n{NK-\-2r]) f^^ction of them and denote the resulting set by 
Sj. K, > is defined later in (V2\ as a function only of the 
number of nodes in the network and not the channel gains, 
while 7^ > is specified later and can be made arbitrarily 
small. We repeat this pruning procedure for all the nodes. 

Denote the intersection of the inverse images of Sj in Co, 
for j = 1, 2, • • • , M, by Co- Transmission of any vector in Co 
results in the received vector at node j belonging to Sj in the 
discrete superposition network. Co forms the set of codewords 
for the Gaussian network. 

Encoding and decoding procedure in the Gaussian network: 
The source in the Gaussian network transmits a codeword 
Xq from Cq- Assume throughout that node 1 can listen, i.e., 
has a link, to the source. Node 1 receives a noisy signal and 
decodes to a vector in Si. We will specify in the sequel 
how this decoding is to be done. Then, using the encoding 
function from Co, it constructs its transmit signal. All nodes 
operate in a similar way. Finally, the destination decodes its 
noisy reception to a signal in 5m, and maps it to a codeword 
by simply using the decoding function from Co. 

Note that we are operating the Gaussian network over the 
digital interface naturally defined by the signals transmitted 
and received in the corresponding discrete superposition net- 
work. 

We summarize the main result concerning the lifting pro- 
cedure in Theorem |3. II 



Theorem 3.1: Consider a Gaussian network with a single 
source -destination pair and M — 1 relay nodes, and consider 
a code for the discrete superposition model of the network that 
communicates at a rate R. 

Then, the lifting procedure and the digital interface defined 
by the discrete superposition model yield a code for the orig- 
inal Gaussian network that communicates at a rate R — Mk,. 

It should be noted that hz (and also M) do not depend on 
the channel gains. Therefore, the above theorem provides a 
lifting procedure that attains a rate in the Gaussian network 
within a bounded amount of R at any SNR. 

The theorem applies to any coding scheme for the superpo- 
sition network and, in particular, to an optimal scheme. Since 
the capacities of the Gaussian and the superposition network 
are within a bounded gap IT], the optimal scheme for the 
superposition network can be lifted to obtain a near-optimal 
coding scheme for the Gaussian network. 



IV. Proof of Theorem [37T] 
Before delving into the details of the proof, we start with 
a genie-based argument explaining the ideas behind the proof 



of Theorem 13.11 

Consider the networks in Fig. |l(a)| and Fig. 



1(b) For 



simplicity, assume node 1 transmits a symbol xi and node 

2 transmits a symbol X2 (instead of a block of symbols each) 
from the alphabet for the discrete superposition network. Node 

3 receives = [hi^xi]-\-[h2sX2] in the discrete superposition 
network in Fig. |l(b)[ and it receives ys = hisXi + /i23^2 + ^3 
in the Gaussian network in Fig. |l(a)[ Rewriting ys, we get 

{hisXi - h[sXi) + {h[sXi - L^'is^iJ) (5) 



ys 



-^{h23Xl - h2sXi) + {h2sXi - L^23^lJ) + ^3 
= : ^3 + ^3 + ^3. 

By definition, y^ lies in Z + and is given by 



^3 



^3 



C3, 



(6) 



(7) 



where C3 is the integer part of the carry obtained by adding 
fractional parts of vs and Z3, i.e., C3 := [(^3 — [^3]) + {zs — 
[zs])]. This gives an upper bound 

H{Ys\Ys) < H{[Vs])^H{[Zs])^H{Cs). (8) 

The real and imaginary parts of [V3] lie in the set 
{-5, -2, . . . , 2, 5}. Hence HdVs]) < 5. Similarly, the real 
and imaginary parts of [Cs] lie in the set { — 1,0,1}, and 
hence H{Cs) < 3. Since zs = z^r + iz^i with the real 
and imaginary parts distributed as independent A/'(0, 1/2), 



2H{[Z^n]) = 2H{Z^^) 
( k) log Pz' (k) 



< 



< 



< 



logTT 
logTT 
logTT 



(k) log 



:exp(-(|fe| + l)2) 



1) 



■m\z3R\ 

•2E(Z|^)+4E(|Z3i^|) + 2 
1 + 2V2 + 2 < 8. (9) 

So H{Ys 1^3) < 16, and these computations can be repeated 
for all the nodes in Gaussian network. In general, if there 
are M incoming signals, rather than just two as in the above 
example, then 

Hm)^H{[Z,])^H{[C,]) (10) 



< log(12M-2) + ll, 



(11) 



where Vj and Cj are defined, as in ([6]), with respect to the 
signal received by node j. Let 

K := log(12M-2) + ll (12) 

be a function of the total number of nodes and independent of 
channel gains (or SNR). Now we use a code designed for the 
superposition network in the Gaussian network. If there were 
a genie providing H{Yj\Yj) bits of data corresponding to the 
received signal to node j in every channel use, then node j 
can recover y. from y.. Since the genie provides at most 
bits to every node, it provides a total of at most Mk, bits. 

Hence, with the genie's aid, a code designed for the discrete 
superposition network can be used in the Gaussian network at 
any SNR. Our proof below prunes a fraction of the codewords 
representing the information that the genie would have pro- 
vided, so that the decoding can work even without the genie. 
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A. The proof 

1) Zero probability of error: Consider the code 
for the superposition network and assume that it has an average 
probabiHty of error 6, where < S < 1/2. Since the 
superposition network is a noiseless network, each codeword is 
either always decoded correctly or always decoded incorrectly. 
Since S < 1/2, less than half of the codewords are always 
decoded incorrectly. Discarding them results in a code where 
all codewords can be successfully decoded, with a small loss 
in the rate. So, without loss of generality, we assume that the 
(2^^, AT) code (and thus also the (2^^^,nAr) code) for the 
superposition network has zero probability of error. 

Xq, the random variable corresponding to the codeword, 
has a uniform distribution with H{2Lo) = NR, and induces 
a distribution on the remaining variables in the network. 

2 ) Operating over blocks of length nN: In the (2^^^, nN) 
code, we assume that every node buffers nN of its received 
symbols, eventually constructing a transmit signal of length 
nN, and transmits it over the next nN channel uses. 



have. 



For the network in Fig. 1(a) this is possible since nodes 
can be grouped into levels such that only nodes at one level 
communicate with another level. For example, nodes 1 and 2 



in Fig. 1 1(a) I can buffer their reception till node completes its 
transmission, then construct their transmit signals, and transmit 
to nodes 3 and 4 over the next nN channel uses. 

For a general network, we need to differentiate between 
signals received by a node at various time instants to account 
for causality in construction of their transmit signals. This 



requires slightly modifying the procedure; see Sec. IV- A6 



3) Pruning the code with respect to node 1: Each y. (or 
X.) in Co is generated by n independent samples from the 
distribution of (or X^). Choose e > 0. For a sufficiently 
large n, node 1 has a collection of at most 2^'^^'^— 1^+^^) ^nd 
at least 2^*^^*^— i^"^^) e-strongly typical received vectors in the 
discrete superposition network corresponding to Co (see ||5|), 
where 62 > 0. As e ^ 0, 62 0. With r] set to 62, we 
construct S\ by randomly selecting a 2"^^^'^+^^) fraction of 
this collection. We do this by choosing a subset uniformly 
among all the subsets of the appropriate size. \S\ \ can be upper 
bounded as follows (see ([T0])-([T2])): 

Similarly, we can show that > 2^(^(^'i)-^'"-^^2) 

For a large n, the number of codewords in Co jointly e- 
strongly typical with a particular can be bounded inde- 
pendently of the chosen y^; see 0. The desired set has 
2n(i/(Xo|y;i)±e2) codewords for a particular y^, i.e., transmis- 
sion of one of those codewords in the superposition network 
results in node 1 receiving the chosen y^. Due to the deter- 
ministic nature of the channel, the sets of codewords in Co 
jointly typical with two different vectors in S\ form disjoint 
sets. To construct Co,i, we pick the set of all codewords in Co 
that are jointly e-strongly typical with some vector in S\. We 



|Co- 



E 



(# of codewords in Co jointly 
e-strongly typical with y^) 



< 



(13) 



^ 2^(^(^i)-^'^-^2) X 2^(^(^ol^i)+e2) 

^ 2n{H{X^)-NK)^ ^^^^ 

where ([16]) follows since H{Y_^\X^q) = 0. Similarly, we can 
show that |Co,i| > 2^(^(^o)-^'^-4e2)^ 

2n/7(XolZi) codewords, 
jointly typical 
with each 




Codewords Set of y ^ 's 

Fig. 3. Pictorial representation of pruning with respect to node 1. 

If the source transmits a codeword from Co,i in the Gaussian 
network, then the signal y^ received by node 1 can be regarded 
as a noisy version of the signal Y-^ it would have received 
in the superposition network, as shown in ([6]). Therefore, 
we define a channel with input and output F^. Node 1 
decodes by finding a vector in Si that is jointly weakly e- 
typical with the received vector in the Gaussian networl|^ 
Since < 2"^^^^— i'— i^"^^)^ decoding is successful with 

block error probability less than where C ^ as n ^ 00. 

4) Further pruning the set of codewords with respect to 
node 2: There are 2"^^^^— 2I— i)^^^) vectors in the set of y^'s 
at node 2 that are jointly e-strongly typical with a particular 
y^ G Si. Since we constructed ^2 by randomly choosing a 
subset containing a 2~"^*^^'^+^^2) fraction of the set of all y^'s, 
for a large n, there are 2"^*^^*^— 2l^i)~^'^^^^2) vectors in ^2 
jointly e-strongly typical with each y^ G Si. Hence, there 
are 2^^^^— i'— 2)~2^'^^^^2) jointly e-strongly typical vectors in 
*Si X ^2 with high probability (whp) as n ^ 00. 

Now, 2"^*^^*^— ol^i'^2)±e2) codewords in Co are jointly e- 
strongly typical with each e-strongly typical tuple in Si x 
S2- We iterate the procedure in the previous subsection by 
collecting the codewords in Co which are jointly e-strongly 
typical with the e-strongly typical tuples in 5i x52, and denote 
this set by Co, 1,2- Naturally, Co, 1,2 is a subset of Co,i. As in 
([T4])-([T6]), we obtain |Co,i,2| is about 2^(^(^o)-2A^'^±7e2) ^^p. 

If the source transmits a codeword from Co, 1,2, then nodes 
1 and 2 can correctly decode to vectors in Si and ^2 
respectively, with high probability for a large n, since \Sj\ < 

2n{IiYr,Y^)-e,) ■ ^ 2}. 

^ Since is a continuous signal, we use weak typicality to define the 
decoding operation. Note that strongly typical sequences are also weakly 
typical; hence sequences in Si are weakly typical. 
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2^^^(1:21X1) vectors jointly, 
typical with each 



Codewords 





Set of y^'s 



2^H(x^\Y„Y^) codewords jointly 
typical with each (y^,y2) 

^^'^et of y'^'s 

Fig. 4. Pictorial representation of further pruning with respect to node 2. 



5) Further pruning with respect to the remaining nodes: 
The same procedure is repeated with respect to the remaining 
nodes in the network. In the end, we obtain a collection of 
at most 2^(^(^o)-^^'^+eM) ^nd at least 2^(^(^o)-^^'^-eM) 

codewords whp, denoted by Co,i,... ,m =• Cq, where eM > 0. 
Note that e^f ^ as e ^ 0. Transmission of a codeword in 
Cg results in the received signal at node j in the superposition 
network belonging to the set Sj . 

Now, if Cg is used on the Gaussian network with encoding 
and decoding procedures at all nodes as described above, then 
the destination can decode to the transmitted codeword whp. 
Thus, on the Gaussian network, Cg achieves the rate 

H{Xq)/N -Mk-cm/M = R- Mk-cm/M, (17) 

where cm can be made arbitrarily small. 

6) Interleaving the codewords for general networks: As 
mentioned in Sec. |IV-A2[ we need to slightly modify the 
lifting procedure for relay networks which have irregular level 
sets that do not permit straightforward buffering of received 
symbols at a node. 

In this case, codewords in Co are constructed by adjoining TV 
blocks of n symbols each, where the first block Xq(1) consists 
only of the first symbols of n codewords of the (2^^, N) code, 
the second block Xq{2) consists only of the second symbols of 
the same codewords, and so on. The source transmits ^o(^)'^ 
in the order of increasing t. 

In the (2^^, TV) code, let ?/^(t), t = l,...,N, denote the 
t-th symbol received by node j. We adjoin the t-th received 
symbols from n uses of the code to construct y .{t). Since 
Xj{t), the t-th symbol transmitted by node j, is a function 
of {^j(p)}p=\, node j can construct x^ (t), vector consisting 
of the t-th transmit symbols from n uses of the code, after 
receiving {y_.{p)Y~X . 

Essentially, we interleave the symbols from n uses of the 
same code to ensure that the nodes can buffer their receptions. 

In order to lift the coding scheme to the Gaussian network, 
we prune Co by randomly picking a 2"^'^'^+^^^ -fraction of the 
set of e-strongly typical ^ . (t), for all t, for all j, and collecting 
the codewords jointly e-strongly typical with them to form Cg- 

In the Gaussian network, each node buffers its reception 
for n time units, decodes to the appropriate Vjit), constructs 



xjt + 1), transmits it on the next n time units. The des- 
tination decodes individual n-length blocks to get Vj^i^), 
t = 1, 2, . . . , A^, and decodes to a codeword in Cg after de- 
interleaving {Vj^it)}. 

V. MIMO NETWORKS 

The results in Theorem 13.11 can be extended to MIMO 
networks, where nodes have multiple transmit or receive 
antennas. In that case, k, determining the bounded gap is a 
function of the number of transmit and receive antennas at the 
various nodes as well as the number of nodes in the network. 

For simplicity, consider a network where every node has 
two transmit and two receive antennas. All transmitted and 
received signals in both the Gaussian and discrete super- 
position model for this network are a pair of vectors. For 
example, node j's received signal in the Gaussian model is 
y. = [y. .^y.o]- channel on a particular wireless 

^ ^' ^' k I 

link (i, j) is specified by four channel gains, {h-j }, where 
k e {1,2} indexes the transmit antennas of i and / G {1,2} 
indexes the receive antennas of j. Assuming that the noises at 
both receive antennas are distributed as CA/'(0, 1), we have 



+ ^¥^1,2 + ^j,^ / = 1, 2. 



(18) 



The arguments in Sections III and IV can be applied 
unchanged to this model by replacing every vector with its 
corresponding tuple of vectors. However, Hi is different: 



:= 21og(24M-2) + 22 

> 2 max H(\Vii]) 
jev\{0} ^' 



where Vj^i and cj^i are defined appropriately with respect to 
y . ^ (see ([6])). The above bound exploits the choice of the same 
number of antennas at every node. Otherwise, we can use the 
maximum number of antennas at any node in the network to 
arrive at a worst-case upper bound. 

VI. Concluding remarks 

We have demonstrated a procedure to lift any coding scheme 
from the discrete superposition model to the Gaussian network. 
The next step that is of interest is to develop good structured 
codes for the superposition model so that we can then lift them 
to obtain good structured codes for the Gaussian network. 
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